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ABSTRACT: Middle school is a crucial stage in student development as students 
prepare for a fast changing future. The science, technology, engineering and 
mathematics (STEM) skills that students acquire in middle school lay the founda¬ 
tion for a successful career in STEM. Moreover, most STEM occupations require 
competencies in science, math and logical thinking prior to engagement in prob¬ 
lem solving. Therefore, it is vital to prepare and develop interest in middle school 
students to participate in the future STEM workforce. This study examines the 
impact of hands-on authentic projects on middle school students’ STEM content 
knowledge and perceptions. The participants for the study were 246 middle 
school students (Grades 6, 7, and 8) from six schools in the states of Texas, Loui¬ 
siana, Maine and Vermont in the United States (U.S.). Employing a quasi- 
experimental design, the students who participated in the project activities were 
measured on their STEM knowledge and dispositions before and after project 
participation. The findings indicate that middle school students who participated 
in standby power monitoring activities not only reported gains in their STEM 
content knowledge, but also showed an improvement in their creative tendencies 
and their perceptions about STEM subjects and careers. This increase in STEM 
perceptions was more pronounced for female middle school students than for 
male students. The results of the study suggest that carefully designed project- 
based activities that encourage inquiry-based learning can be very effective at the 
middle school level. 
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Introduction 

In the United States as in many nations, efforts are being made to improve 
science, technology, engineering and mathematics (STEM) education and 
make it a national priority to strengthen the nation’s position in discovery 
and innovation globally (The White House, 2009). The skills in STEM 
areas that students acquire in middle school lay the foundation for a suc¬ 
cessful career in STEM (Woolley, Strutchens, Gilbert, & Martin, 2010). 
Most STEM occupations require competencies in science, mathematics 
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and logical thinking to allow problem solving. Middle school is a crucial 
stage in student development as students prepare for a fast changing future 
(George, Stevenson, Thomason, & Beane, 1992). Therefore, it is vital to 
prepare and develop interest in middle school students to participate in the 
future STEM workforce. The current study is important as it explores 
middle school students’ dispositions towards STEM subjects and exam¬ 
ines the impact of project-based learning on students’ STEM content 
knowledge as well as perceptions of STEM content and career percep¬ 
tions. Gender differences and implications of findings are also discussed. 

Conceptual Framework 

This study is part of a three-year National Science Foundation (NSF) In¬ 
novative Technology Experiences for Students and Teachers (ITEST) pro¬ 
ject, which aims to focus pre-teen interest in activities to foster learning 
about energy consumption in students’ homes and communities, and to 
incubate interests and knowledge about STEM majors and careers. The 
theoretical foundation of the project is referred to as productivity-centered 
service-learning (IITTL, 2010), a term coined by a member of the project 
research team to describe: a) the multiple theory basis formed from the 
theories of constructivist learning (Bentley, E. Ebert, & S. Ebert, 2007; 
Lave & Wenger, 1991; Means, 2003), b) theories that bear on the intersec¬ 
tion of technology and real-world scientific inquiry in K-8 classrooms 
(Bentley et al., 2007; Bevan & Semper, 2006; Crane, Nicholson, Chen, & 
Bitgood, 1994; Douglas, 2006; Glock, Meyer, & Wertz, 1999), and c) 
game and simulation-based learning theory (Aldrich, 2005; Gibson, Al¬ 
drich, & Prensky, 2006; Gibson, Grasso, & Bongard, 2006; Klein, 1995; 
Pfeiffer & Ballew, 1988; Prensky, 2001; Shaffer, 2005). 

Inquiry-based learning has been strongly encouraged by most science 
educators because students are provided with opportunities to ask ques¬ 
tions, explore, plan, and most importantly, construct new knowledge and 
reflect on their learning (Chen & Howard, 2010; Shedletzky & Zion, 
2005). Project-based learning, where students involved in inquiry work on 
real-world projects and are encouraged to form their own conclusions 
(Savery, 2006), can narrow the gap between academics and the actual 
practice of the profession (Verma, Dickerson, & McKinney, 2011). When 
activities such as standby power monitoring in the current study integrate 
science and mathematics, it helps develop interest in both content areas 
(Sherrod, Dwyer, & Narayan, 2009). Such hands-on activities cannot only 
improve achievement but also develop communication, critical thinking 
and problem-solving (Verma et al., 2011). 

In Europe as well as the U.S., an alarming decline in student interest 
in STEM has been noted (Rocard et al., 2007). A European Commission 
panel of experts has indicated that interest in STEM is directly related to 
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how STEM is taught in schools. The European Commission has recom¬ 
mended the use of inquiry-based methods such as those featured in the 
MSOSW project, that have been judged to be effective in engaging stu¬ 
dents in STEM learning (Healey, 2005). The European Commission indi¬ 
cates that inquiry-based science education (IBSE) can improve science 
learning at both primary and secondary levels by increasing students' in¬ 
terest, from the weakest to the most capable student (Rocard et al., 2007). 

Educational Significance: Why Middle School? 

According to many sources, STEM career intervention and enrichment 
plans should be initiated well before the high school years (George et al., 
1992). As education and popular perception of technology and engineer¬ 
ing standards evolve, there is an increased awareness of the need for 
STEM literacy within society. STEM literacy fosters intelligent participa¬ 
tion in public socio-scientific and ethical decisions, which direct the future 
of engineering and technology (Gorham, 2002; Stiller, De Miranda, & 
Whaley, 2007). Many studies focus on factors affecting students’ attitudes 
towards science such as the influence of teachers, parents and peers on 
students’ science attitudes (George, 2006; Rodrigues, Jindal-Snape, & 
Snape, 2011; Sevinc, Ozmen, & Yigit, 2011). However, there is a need for 
more studies evaluating the effectiveness of authentic hands-on projects in 
STEM content areas. 


MSOSW Project 

The Middle Schoolers Out to Save the World (MSOSW) project was de¬ 
signed to develop middle school students’ interest in STEM content areas 
and to prepare students for the STEM workforce. The ongoing project 
aims to direct middle school student enthusiasm for hands-on activities, 
and to guide students to solve real-world problems. Students in this study 
are trained by their teachers to use energy monitoring equipment to moni¬ 
tor and audit power consumption by consumer electronic devices in their 
homes and communities. 

Standby power (also called Vampire Power) is the electricity con¬ 
sumed by many appliances when they are plugged in but “turned off’ 
(U.S. Department of Energy, 2011). Many appliances consume some elec¬ 
tricity while not performing any useful function. The U.S. Department of 
Energy has estimated that over the lifetime of a typical home appliance, 
70% of the power consumed will be when the appliance is turned off 
(U.S. Department of Energy, 2011). Televisions, game consoles, home 
computers and microwaves are a few of the appliances that commonly 
consume standby power. With the help of their teachers, sixth and seventh 
grade students learn to measure the vampire power use of various appli- 
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ances in the students’ homes. After measuring standby power, students 
gather their data together with their classmates in spreadsheet projections 
to explore energy conservation plans that can lower a family’s monthly 
electric bill and reduce the greenhouse gas emissions that contribute to 
global warming. Students share their results with other middle school stu¬ 
dents from across the U.S. 

These MSOSW project activities are grounded in practices based on 
inquiry-based learning, and project-based learning to make the learning 
experience more student-centered. Guided by inquiry-based learning prac¬ 
tices, the MSOSW project activities (standby power monitoring, project¬ 
ing global impact on climate) are designed to encourage students to ques¬ 
tion, think critically and solve authentic problems (Savery, 2006). Project- 
based learning practices are also included to organize the MSOSW activi¬ 
ties around achieving a shared project goal. In both inquiry-based learning 
and project-based learning, the teacher plays a role of a facilitator provid¬ 
ing students with guidance and feedback. The students in the MSOSW 
activities are provided with details about the project. Whenever students 
encounter problems, these problems are treated as “teachable moments” 
(Savery, 2006). 


Research Questions 

Four research questions with corresponding hypotheses are addressed in 
this study. 

1. What is the effect of the Middle Schoolers Out to Save the World 
(MSOSW) project activities on middle school students’ STEM content 
knowledge? 

Null Hypothesis: The MSOSW project activities will have no effect on 
middle school students’ STEM content knowledge. 

Research Hypothesis: The MSOSW project activities will have a positive 
effect on the middle school students’ STEM content knowledge. 

2. What is the impact of the MSOSW project activities on middle school 
students’ perceptions of science, technology, engineering, and mathemat¬ 
ics? 


Null Hypothesis: The MSOSW project activities will have no impact on 
how the middle school students perceive the STEM content areas. 

Research Hypothesis: The MSOSW project activities will have a positive 
impact on how the middle school students perceive the STEM content are¬ 
as. 


3. What is the effect of the MSOSW project activities on the middle 
school students’ perceptions of and/or aspirations for STEM careers? 
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Null Hypothesis: The MSOSW project activities will have no impact on 
middle school students’ perceptions of and aspirations for STEM careers. 
Research Hypothesis: The MSOSW project activities will have a positive 
impact on the middle school students’ perceptions of and aspirations for 
STEM careers. 

4. How do the male and female middle school students differ in their im¬ 
provement in STEM content knowledge and perceptions after participat¬ 
ing in the MSOSW activities? 

Null Hypothesis: There will be no differences in the improvement of male 
and female students in their STEM content knowledge and perceptions af¬ 
ter participating in the MSOSW activities. 

Research Hypothesis: There will be differences in the improvement of 
male and female students in their STEM content knowledge and percep¬ 
tions after participating in the MSOSW activities. 

The section Results will focus on answering these questions. 

Review of Relevant Literature 

A review of the literature on middle school students’ attitudes towards 
science (McCoy, 2006) revealed that during the first portion of the 21 st 
century there was a decrease in interest in science and a decrease in belief 
that taking science courses in school would enable students to contribute 
to society. Attitudes formed in middle school have a great influence on the 
science and mathematics courses that students take in high school (Misiti, 
Shrigley & Hanson, 1991). Substantiating this trend, George (2006) notes 
that attitudes about science positively relate to how middle school students 
perceive the usefulness of science. Although students value the utility of 
science, fewer students take STEM coursework as they move to high 
school. Several studies have found a significant relationship between stu¬ 
dents’ attitudes towards STEM areas and their actual performance (Choi 
& Chang, 2009; Hammouri, 2004; Liu, 2008). Further, self-confidence in 
mathematics and anxiety towards mathematics (Liu, 2008) has a strong 
influence on students’ mathematics achievement. Understanding if an in¬ 
tervention is effective on students’ achievement in STEM areas is im¬ 
portant because adolescent students with low mathematics achievement 
have lower STEM career aspirations than students with higher mathemat¬ 
ics achievement (Choi & Chang, 2009). 

The National Council of Teachers of Mathematics (NCTM) indicates 
that students should have a proper understanding of mathematics and 
know how to apply mathematics concepts. The research of Sherrod et al. 
(2009) shows that it is more useful when students learn mathematics inte¬ 
grated with other content areas such as science rather than when learning 
mathematics concepts in isolation. It is also important to allow students to 
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assume the roles of scientists and mathematicians to investigate, calculate, 
and analyze data to solve the problems (Sherrod et al., 2009). Kesici and 
Erdogan (2009) have shown that students’ anxiety about mathematics can 
affect achievement and perceptions about mathematics ability. Creating 
positive experiences with mathematics, such as the project activities in 
this study, can help influence students perceptions about mathematics. 

Several factors influence whether or not a student will decide to pur¬ 
sue a career in engineering. Some factors involve how social circles, in¬ 
cluding students’ parents, peers, and teachers guide or influence a stu¬ 
dent’s perceptions about engineering, (Fralick, Kearn, Thompson & Ly¬ 
ons, 2009) and achievement in STEM areas (Woolley et al., 2010). In 
Fralick et al. (2009)’s study on how middle school students perceive engi¬ 
neers and scientists, the majority of the student drawings showed the sci¬ 
entist as a male person wearing a lab coat. Students generally drew engi¬ 
neers as individuals working outdoors, doing physical actions such as 
building or operating machinery, rather than highlighting higher-level 
mental functions such as experimenting. The authors pointed out that it 
was not just a misconception about engineers; instead, it was a lack of 
basic understanding about engineering and what engineers do. More 
hands-on authentic activities are essential to help students understand 
what it entails to become an engineer. A review of engineering outreach 
programs emphasizes the need to introduce engineering at an earlier age. 

Technology is an integral part of today’s classrooms. Many research 
studies have shown that using computers increases student motivation and 
enhances the learning experience of students (Hsieh, Cho, Lui, & Schal- 
lert, 2008). Hsieh et al. (2008) suggested that computers provide more 
opportunities for authentic learning. In technology-enhanced environ¬ 
ments, students are self-directed and collaboratively explore solutions for 
the given problem. In the study of using technology-enhanced environ¬ 
ments, middle school students who participated showed a significant in¬ 
crease in their science achievement (Hsieh et al., 2008). Crucial to these 
active learning environments is how students perceive the use of comput¬ 
ers for learning. A multi-year study on portable technology reported that 
students generally have positive attitudes towards portable devices, which 
may contribute to offsetting the decline in motivation that students experi¬ 
ence in middle school years (Hill, Reeves, Grant, Wang & Han, 2003). 

Gender Differences in STEM Perceptions and Achievement 

Gender differences in STEM interest and achievement have been the sub¬ 
ject of numerous discussions in scholarly literature (Choi & Chang, 2009). 
Although earlier studies have shown that male students perform better in 
STEM areas than female students, Choi and Chang (2009) observed that 
recent studies have shown mixed results. As Knezek, Christensen & Ty- 
ler-Wood (2011) argued, the gender gap is less of an ability gap than a 
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gap in perceptions of science careers (Knezek, Christensen, & Tyler- 
Wood, 2011). Liu (2008) observed that girls had better mathematics 
grades on classroom tests while boys had better mathematics scores on 
standardized tests. This difference was attributed to the social aspect of 
the classroom compared to the impersonal standardized test environment. 
Including social aspects in science and mathematics activities may be 
more effective for girls. In their study of science attitudes of high school 
students, Quinn and Lyons (2011) found that although there was no gen¬ 
der difference in how students enjoyed science, boys reported enjoying 
science more in comparison with other content areas. Fewer than 10% of 
engineers in the United States are female (Hirsch, Carpinelli, Kimmel, 
Rockland, & Bloom, 2007). Many women have historically been relative¬ 
ly uninformed about STEM fields and many are thought to have a higher 
attraction to career fields perceived as being of service to society (Hirsch 
et al., 2007). 


Research Design and Methods 

This research employed a quasi-experimental research design. The partic¬ 
ipants for the study were 246 middle school students from six schools in 
Louisiana, Texas, Maine and Vermont. The majority of the participants 
were from 7 th grade. Male (n = 123) and female students (n = 123) were 
equally represented in the sample. Data for this study were gathered as 
part of a larger study during the year 2010-2011. Online surveys were 
administered to the MSOSW students during the first months and again 
during the last months of a nine-month school year. A battery of instru¬ 
ments was used to measure knowledge of standby power, attitudes toward 
STEM content and careers, learning dispositions such as creative tenden¬ 
cies, motivation, study habits, and interest in various careers. Only the 
variables used in the current research are discussed here. The number of 
subjects involved in the examination of each research question varied 
widely, depending upon the number of sites that completed relevant 
treatments and the ability to match specific pretest records to post test rec¬ 
ords. In each case, the relevant statistical test with the greatest precision 
was employed. For example, a paired t test involving 75 students identi¬ 
fied as pre-post matched pairs would be selected over a non-paired t test 
involving a larger group of perhaps n = 140 without IDs sufficient to pro¬ 
duce matched pairs. 

Demographic information 

A demographic questionnaire was administered to assess participants’ 
gender, grade-level and school information. 
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STEM dispositions and STEM career attitudes 

The STEM Semantics Survey (Tyler-Wood, Knezek, Christensen, 2010) 
was used to measure interest in each STEM subject as well as interest in 
STEM careers more generally. The STEM Semantics Survey was adapted 
from Knezek and Christensen's (1998) Teacher's Attitudes Toward Infor¬ 
mation Technology Questionnaire (TAT) derived from earlier Semantic 
Differential research by Zaichkowsky (1985). The five most consistent 
adjective pairs of the ten used on the TAT were incorporated as de¬ 
scriptors for target statements reflecting perceptions of science, mathemat¬ 
ics, engineering and technology. A fifth scale representing interest in a 
career in science, technology, engineering, or mathematics (STEM) was 
also created. The internal consistency ratings for the five subscales ranged 
from 0.88 to 0.93, which can be considered very good (DeVellis, 1991). 
The five scales had five items each and each item was presented as se¬ 
mantic adjective pairs (fascinating: mundane; exciting: unexciting, and so 
forth) to describe STEM dispositions and career attitudes. A copy of this 
survey is provided in the Appendix 1. 

Results 


Content Knowledge 

The MSOSW students gained knowledge of standby power during the 
2010-2011 school year. Analysis of paired pre-post data from 246 middle 
school students on the National Geographic Vampire Power test (Meier, 
2009) revealed that for boys (^(122) = 5.44, p < .001) and girls (^(122) = 
5.05, p < .001) there was a significant gain in knowledge of standby 
(vampire) power sources and remedies. The effect size (Cohen's d) was 
0.68 and 0.60 for boys and girls respectively. These are placed between 
moderate and large effect sizes according to the guidelines provided by 
Cohen (1988) of small = 0.2, moderate = 0.5 and large = 0.8. These effect 
sizes are well beyond the ES = 0.3 criterion that is normally considered 
educationally meaningful according to established research guidelines 
(Bialo & Sivin-Kachala, 1996). The gain in STEM content knowledge for 
male and female students is shown in Figure 1. As seen in Figure 1, both 
male and female students improved in their knowledge about Vampire 
Power. 
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Table 1. Pre-Post Gains in Vampire-Power scores for 2010-11 MSOSW 
Students: Grades 6-8 


Scale 

Group 

n 

M 

SD 

t 

Sig. 

ES 

Males 

Pretest 

123 

3.58 

1.66 

5.44 

.001 

.68 


Post Test 

123 

4.76 

1.79 




Females 

Pretest 

123 

3.84 

1.71 

5.05 

.001 

.60 


Post Test 

123 

4.92 

1.89 





Note. N =123 



Male Female 


Figure 1. Pre-post gains in vampire power knowledge by MSOSW students 
2010 - 11 . 

STEM Dispositions: Perceptions of Science, Technology, Engineering, 
and Mathematics 

Analyses have confirmed that more positive STEM dispositions emerged 
among MSOSW participants in selected areas. Overall, based on identifi¬ 
able matched pairs pre-post data from 170 middle school students from 
four MSOSW treatment schools, dispositions became more positive in all 
five areas measured by the STEM Semantic Survey (see Table 2). The 
likelihood of this occurrence by chance is quite small (binominal one- 
tailed probability, p = .03), indicating that STEM dispositions in general 
became more positive during MSOSW activities. Semantic perceptions of 
technology increased significantly (p < .05) between pretest and post test 
measurement times. 
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Table 2. Pre-Post Changes in Middle School STEM Dispositions 




n 

M 

SD 

ES 

Paired t 

DF 

Sig. 

Science 

Pre 

145 

5.20 

1.37 

0.07 

-.581 

144 

.562 


Post 

145 

5.30 

1.59 





Mathematics 

Pre 

143 

4.65 

1.54 

0.11 

-.871 

142 

.385 


Post 

143 

4.83 

1.70 





Engineering 

Pre 

137 

4.78 

1.46 

0.08 

-.672 

136 

.502 


Post 

137 

4.92 

1.82 





Technology 

Pre 

141 

5.44 

1.53 

0.23 

-2.00 

140 

.047* 


Post 

141 

5.80 

1.60 





STEM Career 

Pre 

150 

5.02 

1.47 

0.12 

-1.04 

149 

.300 


Post 

150 

5.22 

1.74 






Note: * p < 0.05 


The pre-post findings on STEM dispositions from one MSOSW school 
(see Table 3) showed that students became significantly more positive on 
the 5-item semantic differential scale of‘To me, math is ” over the course 
of the school year, which included MSOSW project activities. Students 
came to see mathematics as more appealing, more exciting, and less bor¬ 
ing. The sixth grade students exhibited large (ES = .93) (Cohen, 1988) 
pre-post gains in their semantic perceptions of mathematics (see Figure 2). 
Such a gain is very unlikely to have occurred by chance (p < 0.005). This 
emergent finding raises an important question as to precisely what combi¬ 
nation of activities and motivations resulted in such large gains at this site. 
Further research is planned in this area. 


Table 3. 6th Grade Semantic Perception of Mathematics 


Scale 

Group 

M 

SD 

Paired t 

Sig. 

ES 

Mathematics 

Pretest 

3.26 

2.04 

-2.92 

.005 

.93 


Post Test 

4.72 

1.10 





Note: N= 19 
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SLU Lab Grade 6 


7 
6 
5 
4 
3 
2 
1 

Pre STEM Math Post STEM Math 



■ Pre STEM Math 

■ Post STEM Math 


Figure 2. Pre-post gains in semantic perception of mathematics (6th grade 
students 2010-11). 

Perceptions of and Aspirations for STEM Careers 

Data gathered by the project’s external evaluators over a two-year period 
indicates that MSOSW students emerge from project activities with in¬ 
creased aspirations for STEM-related careers. Five multiple-choice ques¬ 
tions were selected by external evaluators and the advisory committee as 
relevant to this project. These were gleaned from the National Center for 
Educational Statistics and the American Women in Engineering item 
banks (www.nsf.gov/statistics). The largest pre-post school-year gains 
were related to students’ understanding of what scientists do, in agreement 
that they can do many different jobs (12.1% increase), and that they can 
work on things that help the world (8.6% increase). The results of 2010-11 
NELS item administration further indicates that students (n = 231) took 
greater part in, or became more aware of opportunities to engage in after 
school programs, computer clubs, and groups where they can build/design 
things. 

The following 2010-11 trends were observed in students’ responses to 
their future career aspirations: 

• MSOSW students showed a 6% increase in desire to have a career 
with “work that makes me think.” 

• MSOSW students showed a 3.4% increase in wanting “work that 
allows me to make lots of money.” 

• MSOSW students showed a 3% increase in agreement with the 
statement that they will look for “work that allows me to use 
math, computer, engineering or science skills.” 
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• MSOSW students showed a 4.8% increase in agreement with the 
statement that they will look for “work that allows me to tell other 
people what to do.” 

• There was a 2.6% increase for the project group in agreement 
with the statement that they will look for “work that allows me to 
help solve problems and create solutions.” 

• MSOSW students started at 85.7% and increased by 2.6% in 
agreement with the statement that they will seek “work that is fun 
to do.” 

• Starting at 70%, there was a 7% increase for MSOSW students in 
agreement with the statement that they will look for “work that al¬ 
lows me to have time with family.” 

• MSOSW students reported an 11.7% increase in agreement with 
the question that they will seek “work that allows me to help my 
community and/or society.” 

• There was a 6.9% increase in agreement with seeking “work that 
is satisfying to me.” 

Gender Differences 

Gender-based differences in STEM perceptions were examined for sci¬ 
ence, technology, engineering, and mathematics content areas. A compari¬ 
son of the gain scores in standard deviation units (effect size, pre to post) 
in STEM perceptions of female and male students is graphically illustrat¬ 
ed in Figure 3. 



Figure 3. Gender differences in stem perceptions (Knezek et al., 2011) 
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These are based on detailed findings provided in Table 4. Female middle 
school students exhibited much greater pre-post gains than their male 
counterparts in perceptions of technology and mathematics. In addition 
females had considerably larger gains in perceptions of engineering and 
science. The female and male students displayed similar gains in their 
overall perceptions of choosing STEM as a career. Note that the compara¬ 
tively large gains for females should be interpreted within the broader 
context of initially lower (pretest) dispositions for females in all areas ex¬ 
cept STEM career perceptions. The dispositions of females often rose ex¬ 
tensively to become more comparable to those of males, over the course 
of the project school year. 


Table 4. Gender Difference in STEM Perception Gains 




Male students 



Female students 


M n 


SD 

ES 

M 

n 

SD 

ES 

Science percep-Pre 

5.32 

77 

1.31 

0.02 

5.07 

68 

1.44 

0.13 

tions 

Post 

5.35 

77 

1.52 


5.25 

68 

1.69 


Mathematics 

Pre 

4.81 

72 

1.51 

-0.04 

4.50 

71 

1.56 

0.27 

perceptions 

Post 

4.75 

72 

1.63 


4.91 

71 

1.77 


Engineering 

Pre 

4.89 

70 

1.52 

0.02 

4.66 

67 

1.40 

0.18 

perceptions 

Post 

4.93 

70 

1.82 


4.91 

67 

1.83 


Technology 

Pre 

5.66 

71 

1.44 

0.06 

5.22 

70 

1.60 

0.40 

perceptions 

Post 

5.74 

71 

1.59 


5.86 

70 

1.63 


STEM career 

Pre 

5.02 

77 

1.50 

0.15 

5.03 

73 

1.45 

0.12 

perceptions 

Post 

5.24 

77 

1.69 


5.21 

73 

1.80 



Discussion 

Probable Impact of Socioeconomic Status 

Several researchers have pointed out the academic disparities between 
students from low socioeconomic backgrounds and those from higher so¬ 
cioeconomic backgrounds on national-level standardized mathematics and 
science tests (Crosnoe, 2009; Woolley et al., 2010). Woolley et al. (2010) 
also pointed out that such achievement gaps are more of gaps in opportu¬ 
nities for learning and quality of services available to students in lower 
socioeconomic status. In a study by Boaler and Staples (2008), students in 
urban schools improved their mathematics achievement scores when 
teachers provided students with a wide range of learning opportunities 
rather than traditional lectures. Support from teachers and high expecta¬ 
tions from peers, parents, and teachers also influenced students’ mathe¬ 
matics achievement (Boaler & Staples, 2008). Although socioeconomic 
status was not a major research question addressed in the MSOSW pro- 
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ject, the research team noted during site visits that the economic prosperi¬ 
ty of the region of the U.S. in which participants resided (four U.S. states 
in the northeast and mid-south), as well as the neighborhood in which an 
individual classroom was located, appeared to impact the dispositions of 
students. 

How does the impact of the MSOSW project activities differ for stu¬ 
dents of low versus high socioeconomic status? This specific research 
question was suggested by an MSOSW teacher in one of the Title I (free 
government lunch) schools participating in the project. This question can¬ 
not be properly addressed with the limited demographic data currently 
gathered for the middle school students participating in MSOSW. Howev¬ 
er, project researchers conjecture that students without access to the Inter¬ 
net at home generally come from families of lower socioeconomic status. 
An analysis of the 2010-11 matched pairs pre-post data (n = 255) revealed 
that approximately 10% (n = 23) of the students in this data set reported 
not having access to the Internet at home. An analysis of variance based 
on Internet access for STEM disposition and career interest gain revealed 
that students without access to the Internet at home became more positive 
from pre to post on all the major STEM indicators gathered, while for 
many with Internet access at home, the pre-post indicators declined. In the 
area of STEM perceptions of engineering and perceptions of STEM ca¬ 
reers, gains were significantly (p < .05) greater for those without Internet 
access at home than for those with Internet access at home. These findings 
imply that MSOSW activities may be especially effective in promoting 
interest in STEM content and careers among disadvantaged students. Fur¬ 
ther research is needed in this area. 

Probable Impact on Creative Tendencies 

A subscale of the Computer Attitude Questionnaire (Christensen & 
Knezek, 2009; Knezek, Christensen, Miyashita, & Ropp, 2000) measuring 
creative tendencies was also used for this study. This instrument has been 
well-validated and employed in national and international comparisons in 
studies in the past (Collis et al., 1996; Morales, Knezek, Christensen, & 
Avila, 2000; Fluke, Knezek, & Christensen, 2001). The Creative Tenden¬ 
cies subscale contained 13 Likert-type items originating from the Nether¬ 
lands and Japan and refined in the U.S. (Collis et al., 1996) with ratings 
ranging from strongly disagree (1) to strongly agree (5). Examples of 
items include: I examine unusual things; I find new things to play with or 
to study without any help; When I think of a new thing , I apply what I 
have learned before; and I create many unique things. The reliability es¬ 
timate for this subscale was found to be very good (0.83) (DeVellis, 1991) 
for the students participating in the MSOSW project, and pre-post changes 
in this area were assessed. 
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How do the MSOSW project activities impact the students’ assess¬ 
ment of their own creative tendencies? Findings from the Computer Atti¬ 
tude Questionnaire (see Table 5) showed that classrooms of students can 
become significantly more positive (p < 0.05) on the subscale Creative 
Tendencies over the course of a school year that includes MSOSW project 
activities. 


Table 5. 6th Grade Creative Tendencies 


Scale 

Group 

Mean 

SD 

Paired t Sig. 

ES 

Creativity 

Pretest 

3.59 

.41 

-1.79 .042 

.30 


Post-test 

3.73 

.51 




Note: N = 31 


As graphically displayed in Figure 4, sixth grade students at an MSOSW 
school identified by project liaisons as employing teaching methods pro¬ 
moting creative uses of the monitoring equipment and data, increased on a 
5-point Likert rating scale of: 1 = strongly disagree, 2 = agree, 3 = unde¬ 
cided, 4= agree and 5 = strongly agree, from pretest (M = 3.59, SD = 
0.41) to post test time (M = 3.73, SD = 0.51). 


GS Grade 6 



Pre Creative Post Creative 

Tendency Tendency 


Pre Creative 
Tendency 

■ Post Creative 
Tendency 


Figure 4. Pre-post gains in self-reported creative tendencies for 6th grade 
MSOSW students 

Although the gain in creative tendencies was small, this increase in self- 
reported creative tendencies was unlikely by chance (t (30) = -1.79, p < 
.05) and was of sufficient magnitude to be considered educationally mean¬ 
ingful (ES = 0.3) (Bialo & Sivin-Kachala, 1996). Overall, creative tenden¬ 
cies for females across project sites started lower than boys before 
MSOSW activities, and advanced toward the level of the boys by post-test 
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time. The gain for girls was significant (F(l, 231,) = 4.17; p < .05) and the 
effect size was approximately 0.3. Further research is needed in this area. 

Findings in the National and International Context 

Declining interest in science and the need to encourage STEM career aspi¬ 
rations and interests at an early age has been recorded by many research¬ 
ers (Archer et al., 2010, Tai, Liu, Maltese, & Fan, 2006). The nature of 
work that students perform in the classroom influences their perceptions 
of mathematics and science and what students value as important to their 
learning (Haitham, 2002; Rukavina, Zuvic-Butorac, Ledic, Milotic, & 
Jurdana-Sepic, 2012). The findings of this study are consistent with those 
of Haitham (2002) in that student perceptions of mathematics and STEM 
content for females are positively impacted by MSOSW activities. Hands- 
on learning and inquiry-based problem solving helps students to become 
motivated independent learners-one of the main goals of education. Real 
world application of science and mathematics through active learning pro¬ 
jects promotes interest in science and mathematics careers (Rukavina et 
al., 2012). Although young students might report that science is fun and 
interesting, this interest might not result in motivation to choose to study 
STEM areas and then pursue a career in STEM (Archer et al., 2010). The 
current study found positive indications that engaging students in hands- 
on STEM activities promotes interest in STEM careers. 

Findings from the MSOSW study also indicate that a proper under¬ 
standing of what a career in STEM entails needs to be embedded in the 
STEM curriculum. Similarly, in a study completed by Dyne and 
Fjermestad (2012), high school female students reported that they were 
not aware of computer science as a career path. Further investigation re¬ 
garding what middle school students perceive as a STEM career is need¬ 
ed. A pilot study by the research team producing this paper (Periathiru- 
vadi, Knezek, Tyler-Wood, & Christensen, 2012) has indicated that for 
the middle school students who participated in MSOSW, student disposi¬ 
tions towards science and mathematics had a greater influence on interests 
in pursuing a STEM career when compared to students’ dispositions to¬ 
wards technology and engineering. Mills (2013) has confirmed a strong 
connection between middle school students’ beliefs in their creative 
tendencies and the attractiveness of STEM as a career. These studies im¬ 
ply that STEM education in school should not stop at teaching only the 
why and how of science and mathematics concepts, but also relate it to 
real-world issues and career goals, as is recommended by Archer et al. 
(2010). Furthermore, rapidly changing technological advancements have 
resulted in a new set of career expectations especially in STEM fields 
(Roehrig, Moore, Wang, & Park, 2012). Real world problems are not iso¬ 
lated issues and often require multi-disciplinary problem solving ap¬ 
proaches drawing on findings from STEM disciplines. 
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The overall findings from MSOSW are supportive of recommenda¬ 
tions established by the European Commission (Rocard et al., 2007). In 
their review of instructional practices, the European Commission recog¬ 
nized that inquiry-based science education (IBSE) is effective with all 
kinds of students from the weakest to the most capable and that ISBE 
seems to be particularly effective at increasing girls' interest in science 
(Rocard et al., 2007). The major outcomes from MSOSW activities in¬ 
cluded large gains for middle school girls, with girls generally becoming 
more positive during the project year to become approximately equal with 
boys. 

The European Commission (Rocard et al., 2007) supports the use of 
inquiry-based learning in the classroom as well as incorporating inquiry- 
based training into teacher education programs. The MSOSW project 
brought the project teachers together for several days each summer to test 
student activities and share successes and difficulties with other participat¬ 
ing teachers. Support continued throughout the project year through online 
mentoring and problem resolution activities led by the project staff. 

Finally, The European Commission (Rocard et al., 2007) indicates 
that inquiry-based science education (IBSE) can improve science learning 
at both primary and secondary levels by increasing students' interest. The 
overall findings from the MSOSW project strongly support this conten¬ 
tion. 

Recommendations for Classroom Improvement of STEM Interest 

Implications of the collective findings of this study can be translated into 
several recommendations for teacher professional development and school 
practice. 

• One recommendation is that schools / policymakers / districts / 
universities should provide additional training opportunities to in¬ 
crease the teaching skills necessary to implement an inquiry-based 
approach to STEM learning in the classroom. Additional training 
would allow teachers to incorporate inquiry- based learning mod¬ 
ules into STEM teaching. 

• As an additional recommendation, it is likely that community par¬ 
ticipation in critical STEM learning projects such as reducing the 
use of standby power would be an asset in encouraging interest in 
STEM careers. It has been noted that students often do not under¬ 
stand the relationship between what they are learning and a STEM 
career. Unless a family member works in a STEM field, most stu¬ 
dents do not know what an actual scientist or engineer does. 

• A final recommendation is to provide a means to explore related 
STEM career opportunities as students acquire STEM knowledge 
in the classroom. 
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Summary and Conclusions 

Four research questions were introduced at the beginning of this paper. 
Major results related to each of these were: 

1. Students taking part in the MSOSW project activities showed a 
significant and meaningful gain in their STEM content knowledge 
tested using the National Geographic Vampire Power test Both 
boys and girls improved in their STEM content knowledge. 

2. Findings on the gain in STEM perceptions after participating in 
MSOSW activities confirmed that more positive dispositions are 
emerging in selected areas. Students from one school came to see 
mathematics as more appealing, more exciting, and less boring. 

3. MSOSW students emerge from project activities with increased 
aspirations for STEM-related careers. The largest pre-post school- 
year gains were related to two survey questions on students’ un¬ 
derstanding of what scientists do, namely agreement that scien¬ 
tists can do many different jobs and that scientists can work on 
things that help the world. 

4. A comparison of the gain scores in STEM perceptions for female 
and male students showed that female students reported greater 
increases in their perceptions of science, engineering, mathemat¬ 
ics and technology. Female students reported greater gains in their 
perceptions of technology and mathematics followed by engineer¬ 
ing and science perceptions. 

Other findings have also emerged from this study. To determine the influ¬ 
ence of socio-economic status, comparison of gains in STEM dispositions 
and career interests were made between students who had access to Inter¬ 
net and those who did not. Students without access to the Internet at home 
became more positive from pre to post on all the major STEM indicators 
gathered. These findings imply that MSOSW activities may be especially 
effective in promoting interest in STEM content and careers among disad¬ 
vantaged students. 

Another area deemed especially worthy of further study is creative 
tendencies. Student participants in MSOSW, especially selected sixth 
graders, reported more positive self-assessment of their own creative 
tendencies. Although the gain in creative tendencies was relatively small, 
this increase in self-reported creative tendencies was unlikely by chance 
and was of sufficient magnitude to be considered educationally meaning¬ 
ful. Further research is needed. 

Overall, we conclude that middle school students definitely gain 
STEM content knowledge during MSOSW activities. More positive dis¬ 
positions toward science, technology, engineering and mathematics are 
emerging in selected areas, with multiple measures providing evidence of 
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increased interest in STEM careers. Increased students’ perceptions of 
their own creative tendencies appear to be an additional project outcome. 
Gains for females are especially large, as are those for students (which we 
assume to be from disadvantaged families) without access to the Internet 
at home. Further research is needed to confirm these findings on a broader 
scale outside the four U.S. states and approximately 600 middle school 
students involved in the project across these states. 

Acknowledgement 

This research was supported by U.S. National Science Foundation Innova¬ 
tive Technologies Grant ITEST #0833706. The authors also wish to 
acknowledge the contributions of external evaluators Penny Nolte and 
Doug Harris to the findings presented in this paper. 

References 

Aldrich, C. (2005). Learning by doing: The essential guide to simulations, 
computer games, and pedagogy in e-learning and other educational 
experiences. San Francisco, CA: Jossey-Bass. 

Archer, L., DeWitt, J., Osborne, J., Dillon, J., Willis, B., & Wong, B. 
(2010). “Doing” science versus “being” a scientist: Examining 10/11- 
year-old school children’s constructions of science through the lens 
of identity. Science Education , 94(4), 617-639. doi: 

10.1002/sce.20399 

Bentley, M., Ebert, E., & Ebert, S. (2007). Teaching constructivist sci¬ 
ence, K-8: Nurturing natural investigators in the standards-based 
classroom. Thousand Oaks, CA: Corwin Press. 

Bevan, B., & Semper, R. (2006). Mapping informal science institutions 
onto the science education landscape. Retrieved from http://www. 
exploratorium.edu/CILS/documents/RTsystemsBB.pdf. 

Bialo, E.R., & Sivin-Kachala, J. (1996). The effectiveness of technology in 
schools: A summary of recent research. Washington, DC: Software 
Publishers Association. 

Boaler, J., & Staples, M. (2008). Creating mathematical futures through 
an equitable teaching approach: The case of Railside School. Teach¬ 
ers College Record, 770(3), 608-645. 

Chen, C.H., & Howard, B. (2010). Effect of live simulation on middle 
school students’ attitudes and learning toward science. Educational 
Technology & Society , 73(1), 133-139. 

Choi, N., & Chang, M. (2009). Performance of middle school students, 
comparing U.S and Japanese inquiry-based science practices in mid¬ 
dle schools. Middle Grades Research Journal , 6 ( 1), 15. 


116 



Science Education International 


Christensen, R., & Knezek, G. (2009). Construct validity for the teachers’ 
attitudes toward computers questionnaire. Journal of Computing in 
Teacher Education, 25(4), 143-155. 

Cohen, J. (1988). Statistical power analysis for the behavioral sciences 
(2nd ed.). Hillsdale, NJ: Lawrence Earlbaum Associates. 

Collis, B., Knezek, G., Lai, K., Miyashita, K., Pelgrum, W., Plomp, T., & 
Sakamoto, T. (1996). Children and computers in school. Mahwah, 
NJ: Lawrence Erlbaum. 

Crane, V., Nicholson, H., Chen, M., & Bitgood, S. (1994). (Eds.) Informal 
Science Learning: What the Research Says About Television, Sci¬ 
ence Museums, and Community-Based Projects. Dedham, MA: Re¬ 
search Communications Ltd. 

Crosnoe, R. (2009). Disparities in School Readiness: How Families Con¬ 
tribute to Transitions Into School. Journal of Family Theory & Re¬ 
view, 7(2), 113-115. 

DeVellis, R.F. (1991). Scale development. Newbury Park, NJ: Sage Publi¬ 
cations. 

Douglas, R. (2006). Linking science & literacy in the K-8 classroom. Ar¬ 
lington, VA: NSTA Press. 

Dyne, V. M., & Fjermestad, J. (2012). Robotics in education: a tool for 
recruiting, engaging, retaining and educating students. Proceedings 
of the 11th WSEAS international conference on Instrumentation, 
Measurement, Circuits and Systems, and Proceedings of the 12th 
WSEAS international conference on Robotics, Control and Manufac¬ 
turing Technology, and Proceedings of the 12th WSEAS international 
conference on Multimedia Systems & Signal Processing , 196-201. 

Fluke, R., Knezek, G., & Christensen, R. (2001). Reconfirmation of the 
association between the Young Children’s Computer Inventory 
(YCCI) and the Computer Attitude Questionnaire (CAQ). In C. Mo¬ 
rales, G. Knezek, R. Christensen, & P. Avila, (Eds.). Users ’ views of 
new information technologies in education: Studies from multiple na¬ 
tions (pp. 29-41). Mexico City: Institute Latinoamericano de la Co- 
municacion Educativa (ILCE). 

Fralick, B., Keam, J., Thompson, S., & Lyons, J. (2009). How middle 
schoolers draw engineers and scientists. Journal of Science Educa¬ 
tion and Technology, 75(1), 60-73. doi: 10.1007/sl0956-008-9133-3 

George, P., Stevenson, C., Thomason, J., & Beane, J. (1992). The middle 
school and beyond. Association for Supervision and Curriculum De¬ 
velopment. Alexandria, VA. 

George, R. (2006). A cross- domain analysis of change in students’ atti¬ 
tudes toward science and attitudes about utility of science. Interna¬ 
tional Journal of Science Education, 28 (6), 571-589. doi: 
10.1080/09500690500338755 


117 



Science Education International 


Gibson, D., Aldrich, C., & Prensky, M. (Eds.). (2006). Games and simula¬ 
tions in online learning. Hershey, PA: Idea Group, Inc. 

Gibson, D., Grasso, D., & Bongard, J. (2006). Games and simulations and 
the future of engineering: Engaging high school students in global 
challenges. Retrieved from http://www.globalchallengeaward.org/ 
Glock, J., Meyer, M., & Wertz, S. (1999). Discovering the naturalist intel¬ 
ligence: Science in the school yard. Tucson, AZ: Zephyr Press. 
Gorham, D. (2002). Engineering and standards for technological literacy. 
The Technology Teacher , 67(7), 29. 

Haitham, M. A. (2002). Attitudes of undergraduate majors in elementary 
education toward mathematics through a hands-on manipulative ap¬ 
proach. Perceptual and Motor Skills, 94( 1), 55-58. 

Hammouri, H. (2004). Attitudinal and motivational variables related to 
mathematics achievement in Jordan: Findings from the Third Interna¬ 
tional Mathematics and Science Study (TIMSS). Educational Re¬ 
search, 46(3), 241-257.doi: 10.1080/0013188042000277313 
Healey, M. (2005). Linking research and teaching: exploring disciplinary 
spaces and the role of inquiry-based learning. In: R. Barnett (ed.) Re¬ 
shaping the University: new relationships between research , scholar¬ 
ship and teaching. London: McGraw Hill/Open University, pp. 67-78. 
Hill, J. R., Reeves, T. C., Grant, M., Wang, S. K., & Han, S. (2003). Year 
four report: Athens Academy laptop evaluation. Athens, GA: Univer¬ 
sity of Georgia. Retrieved from http://lpsl.coe.uga.edu/ 
Projects/AAlaptop/pdf/Year4ReportF inal.pdf 
Hirsch, L., Carpinelli, J., Kimmel, H., Rockland, R., & Bloom, J. (2007). 
“The differential effects of pre-engineering curricula on middle 
school students’ attitudes to and knowledge of engineering careers.” 
Presented at the 37th ASEE/IEEE Frontiers in Education Conference. 
Retrieved from http://fie-conference.org/fie2007/papers/1205.pdf 
Hsieh, P., Cho, Y., Liu, M, & Schallert, D. (2008). Examining the inter¬ 
play between middle school student's achievement goals and self- 
efficacy in a technology-enhanced learning environment. American 
Secondary Education, 36(3), 33-50. 

IITTL. (2010). Middle schoolers out to save the world. Retrieved from 
http://iittl.unt.edu/IITTL/itest/msosw_web/ 

Kesici, S., & Erdogan, A. (2009). Predicting college students' mathemat¬ 
ics anxiety by motivational beliefs and self-regulated learning strate¬ 
gies. College Student Journal, 43(2), 631-642. 

Klein, H. (1995). Teaching and interactive methods: With cases, simula¬ 
tions, and games. Needham, MA: WACRA - World Association for 
Case Method Research & Application. 

Knezek, G., & Christensen, R. (1998, March). Internal consistency relia¬ 
bility for the teachers’ attitudes toward information technology 
(TAT) questionnaire. In S. McNeil, J. Price, S. Boger-Mehall, B. 


118 



Science Education International 


Robin, & J. Willis (Eds.), Proceedings of the Society for Information 
Technology in Teacher Education Annual Conference (pp. 831-836). 
Bethesda, MD: Society for Information Technology in Teacher Edu¬ 
cation. 

Knezek, G., Christensen, R., & Tyler-Wood, T. (2011). Contrasting per¬ 
ceptions of STEM content and careers. Contemporary Issues in 
Technology and Teacher Education, 11(f), 92-117. 

Knezek, G., Christensen, R., Miyashita, K., & Ropp, M. (2000). Instru¬ 
ments for assessing educator progress in technology integration. 
Denton, TX: Institute for the Integration of Technology into Teach¬ 
ing and Learning (IITTL). 

Lave, J. & Wenger, E. (1991). Situated learning: Legitimate peripheral 
participation. Cambridge, MS: Cambridge University Press. 

Liu, F. (2008). Impact of online discussion on elementary teacher candi¬ 
dates' anxiety towards teaching mathematics. Education , 128(A), 614- 
629. 

McCoy, J. (2006). Improving middle school students’ attitudes towards 
science. Journal of Teacher Initiated Research , 3(10), 129-134. Re¬ 
trieved from 

http://www.otterbein.edu/Education/JTIR/VolumeIII/mccoy.pdf 

Means, B. (2003). Technology and Constructivist Learning. Retrieved 
from http://www.ncrel.org/cscd/pubs/lead51/5 lmeans.htm 

Meier, A. (2009). National Geographic Vampire Power Test. Retrieved 
from http://ngm.nationalgeographic.eom/2008/04/climate/standby- 
quiz-interactive. 

Mills, L. (2013). Middle school predictors of STEM career interest: Indi¬ 
cators of STEM career interest among public middle school students 
in the United States. (Unpublished doctoral dissertation) .University 
of North Texas, Denton. 

Misiti, F., Shrigley, R., & Hanson, L. (1991). Science attitude scale for 
middle school students. Science Education, 75(5), 525-540. doi: 
10.1002/sce.3730750504 

Morales, C., Knezek, G., Christensen, R. & Avila, P. (Eds.) (2000). Im¬ 
pact of new technologies on teaching and learning. Mexico City: In¬ 
stitute Latinoamericano de la Comunicacion Educativa (ILCE). 

National Council of Teachers of Mathematics [NCTM] (2012). Retrieved 
from http://www.nctm.org/standards/content.aspx?id=26798 

Periathiruvadi, S., Knezek, G., Tyler-Wood, T., & Christensen, R. (2012). 
“Predictors of STEM career interest among attitudes and dispositions 
of middle school students.” Paper presented to the American Educa¬ 
tional Research Association Annual Meeting, Vancouver, Canada. 

Pfeiffer, J. W., & Ballew, A. C. (1988). Using case studies, simulations, 
and games in human resource development. San Diego, CA: Univer¬ 
sity Associates. 


119 



Science Education International 


Prensky, M. (2001). Digital game-based learning. New York: McGraw- 
Hill. 

Quinn, F. & Lyonns, T. (2011). High school students’ perceptions of 
school science and science careers: A critical look at a critical issue. 
Science Education International , 22(4), 225-238. 

Rocard, M., Csermely, P., Jorde, D., Lenzen, D., Walberg-Henriksson, H., 
& Hemmo, H. (2007). Science education now: A renewed pedagogy 
for the future of Europe. Brussels: European Commission. Retrieved 
from http://ec.europa.eu/research/science-society/document_library/ 
pdf_06/ 

Rodrigues, S., Jindal-Snape, D. & Snape, J. B. (2011). Factors that influ¬ 
ence student pursuit of science careers; the role of gender, ethnicity, 
family and friends. Science Education International , 22(4), 266-273. 

Roehrig, G. H., Moore, T. J., Wang, H. H., & Park, M. S. (2012). Is add¬ 
ing the E enough? Investigating the impact of k-12 engineering 
standards on the implementation of stem integration. School Science 
and Mathematics , 772(1), 31-44. 

Rukavina, S., Zuvic-Butorac, M., Ledic, J., Milotic, B., & Jurdana-Sepic, 
R. (2012). Developing positive attitude towards science and mathe¬ 
matics through motivational classroom experiences, Science Educa¬ 
tion International , 23(1), 6-19. 

Savery, J. (2006). Overview of Problem-based Learning: Definitions and 
Distinctions. Interdisciplinary Journal of Problem-based Learning, 
7(1), 9-20. 

Sevinc, B., Ozmen, H. & Yigit, N. (2011). Investigation of primary stu¬ 
dents’ motivation levels towards science learning. Science Education 
International , 22(3), 218-232. 

Shaffer, D. W. (2005). Epistemic games [Electronic version]. Innovate: 
Journal of Online Education, 1(6). Retrieved from http://www. 
innovateonline.info/index.php?view=article&id=79. 

Shedletzky, E., & Zion, M. (2005). The essence of open inquiry teaching. 
Science Education International, 7d(l), 23-38. 

Sherrod, S. E., Dwyer, J., & Narayan, R. (2009). Developing science and 
math integrated activities for middle school students. International 
Journal of Mathematical Education in Science and Technology , 
40( 2), 247-257. doi. 10.1080/00207390802566923 

Stiller, T., De Miranda, M., & Whaley, D. (2007). Engineering education 
partnership. The International Journal of Engineering Education , 
23(1), 58. 

Tai, R. H., Liu, C. Q., Maltese, A. V. & Fan, X. (2006). Planning early for 
careers in science. Science , 372(5779), 1143-1144. doi: 10.1126/ 
science. 1128690. 


120 


Science Education International 


Tyler-Wood, T., Knezek, G., & Christensen, R. (2010). Instruments for 
assessing interest in stem content and careers. Journal of Technology 
and Teacher Education, 18(2), 341-363. 

U.S. Department of Energy. (2011). When to turn off personal computers. 
Retrieved from http://www.energysavers.gov/your_home/ 

Verma, A. K., Dickerson, D., & McKinney, S. (2011). Engaging Students 
in STEM careers with Project-Based Learning - Marine Tech Project. 
Technology & Engineering Teacher, 77(1), 25-31. 

The White House. (2009). Educate to innovate campaign for excellence in 
science, technology, engineering & math (STEM) education. Re¬ 
trieved from http://www.whitehouse.gov/the-press-office/president 
-obama-launches-educate-innovate-campaign-excellence-science- 
technology-en 

Woolley, M. E., Strutchens, M. E., Gilbert, M. C., & Martin, W. G. 
(2010). Mathematics success of Black middle school students: Direct 
and indirect effects of teacher expectations and reform practices. The 
Negro Educational Review, 67(1-4), 41-59. 

Zaichkowsky, J. L. (1985). Measuring the involvement construct. Journal 
of Consumer Research, 72(3), 341-352. 


121 



Science Education International 


Appendix 1 


STEM Semantics Survey 


Gender: M / F 

This five-part questionnaire is designed to assess your perceptions of sci¬ 
entific disciplines. It should require about 5 minutes of your time. Usually 
it is best to respond with your first impression, without giving a question 
much thought. Your answers will remain confidential. 


ID: 

Use the assigned ID or the year and day of your birth¬ 


day (ex: 9925 if born on the 25 th day of any month in 

School: 

1999. 


Instructions: Choose one circle between each adjective pair to indicate 
how you feel about the object. 


To me, SCIENCE is: 


1 . 
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EM 
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To me, TECHNOLOGY is: 
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